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ABSTRACT 

This paper describes a project undertaken for the 
Swiss National Science Foundation to investigate the efficiency of 
the Swiss education systems. The project entailed a literature review 
of current international trends in school-effectiveness and 
school-improvement research; a survey of 57 researchers in 10 
countries; i survey of researchers in Switzerland, Germany, and 
Austria; and an international workshop at which the future of Swiss 
educational research was considered. Survey responses were received 
from 25 researchers from the United States, the United Kingdom, 
Canada, Australia, Hong Kong, Macau, and Norway and identified the 
most significant lines of inquiry for school-effectiveness and 
school-improvement research as the multilevel measurement of school 
effects and the dynamics of school change. Forty percent recommended 
a combination of qualitative and quantitative methods, although 
school-effectiveness researchers tended to prefer quantitative 
methods and school-improvement researchers tended to use qualitative 
methods. They identified commitment, sufficient funding, networking 
and collaboration as necessary infrastructure components. 
German-speaking experts' recommendations include: future 
investigations should examine the relationship between school quality 
and oranizational structure; pay greater attention to comparative 
research and theoretical development and conduct more case studies of 
improving schools; utilize multilevel methods and theories; and 
create links among theory, research, and practice. Three figures are 
included. Appendices contain results of the 10-nation survey. 
(LMI) 
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Collins Cobuild Essential English Dictionary 

• To stimulate something means to encourage it to begin or develop further. 

• If something stimulates you, it makes you feel full of ideas and enthusiasm. 



Abstract 



This paper describes a project undertaken by the authors for the Swiss National 
Science Foundation through its National Research Program 33 (titled "Efficiency 
of the Swiss education systems") involving: (a) analyses of current trends in 
international school effectiveness and school improvement research; (b) surveys 
of expert opinion concerning the most productive lines of enauiry, appropriate 
methodology and necessary infrastructure for the initiation and maintenance of 
a viable national research effort in school effectiveness and school 
improvement; and (c) an international workshop at which the implications of the 
trend analyses and surveys for future Swiss educational research were 
considered. As well as presenting the results of the formal, commissioned 
aspects of the project (i.e. the reports, workshop, recommendations) the authors 
describe some of its unintended, unpredicted outcomes. 
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Background 



In 1990 the Swiss National Science Foundation (SNSF) established a SFr. 15 million 
National Research Program (NRP33) into the effectiveness of Swiss educational 
systems 1 at a time when reduced financial resources available to the Swiss 
education sector were giving rise to concerns about its efficiency as well as its 
comparative international standing 2 . At the time of writing (December 1994) 29 
research projects had so far been funded by the program. 

A goal of the program is to increase the existing educational research capacity 
in Switzerland through encouraging coordination among, and cooperation 
between, (somewhat isolated) educational researchers working in a variety of 
(usually small) university departments and other educational institutions 3 . An 
expansion in knowledge about educational effectiveness, the promotion of 
evaluation and self-evaluation in the education systems as well as an increase in 
its flexibility and potential for innovation are further goals of the program (Trier, 
1993). 

As a result of the relatively broad brief provided to applicants for research 
funding within the program, certain significant areas of educational research 
falling within its general framework were considered to be lacking by the expert 
committee appointed to oversee the program. In their desire to plug these 
gaps, the expert committee commissioned a number of trend reports to 
provide a basis for decision-making about more specifically targeted research 
activities. The present project is one of these. 

The authors of the present paper and a third member of the project team 
(Bernard Favre) were commissioned to: 

• produce and disseminate draft reports analysing current trends in school 
effectiveness and school improvement research as reported in the English-, 
French- and German-language professional literature; 

• convene a two-day workshop 4 in which the deliberations of selected 
international and national researchers should stimulate the development of 
recommendations for suitable content , appropriate methodology and 
necessary infrastructure for future Swiss school effectiveness and school 
improvement research; and 

• submit a final report (under the working title International trends in school 
effectiveness and school improvement research: A S wiss perspective) 
containing recommendations which are not only consistent with promising 
international developments, but also reflect the specific needs of, and 
parameters afforded by, the Swiss education systems. 



1 The existence of 26 autonomous cantonal school systems is reflected in the 
use of the plural form. 

2 Background material about education in Switzerland, particularly concerning 
the funding of Swiss educational research in comparison with that of other 
social and industrial sectors, will be distributed separately at the 
conference session in which this paper is presented. 

3 The Organization for Economic Co-operation and Development country report on 
Switzerland (OECD, 1991) and the Swiss Science Council (1993) have presented 
the state of educational research in this country in more detail. 

4 Held in Solothurn on 7th-8th November 1994. 
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Activities of project group 

Although working within certain practical constraints imposed by relatively tight 
funding and duration parameters, the authors undertook the following activities: 

• they conducted an exhaustive electronic and traditional search of English-, 
French- and German-language education data bases and located relevant 
documents; 

• they held discussions and exchanged correspondence with colleagues in 
universities and other educational research institutes in a number of countries; 

• they carried out formal surveys of expert opinion within and outside 
Switzerland; 

• they attended relevant national and international seminars and conferences; 

• they convened an international workshop in which Swiss educational 
researchers interested in school effectiveness and school improvement were 
joined by international colleagues; and 

• they prepared the current paper as a preliminary basis for the introductory 
and synthesising chapters in the planned final report. 

With their main work places scattered throughout Switzerland (Szaday at the 
Central Swiss Educational Consultancy Service in Lucerne, Bueler at the Institute 
for Education at the University of Zurich and Favre at the Centre for Sociological 
Research in Geneva) 5 , their differing professional backgrounds and educational 
research approaches, as well as being personally unknown to one another prior 
to this project, the task of coordinating and synthesising the work has been quite 
a challenge! 

The extent to which their collaboration has been fruitful is a reflection of the 
degree of attainment of the stated goal of the National Research Program to 
foster collaborative educational research efforts between individuals and 
institutions across the various language regions of Switzerland. At the interface of 
three major European cultures (French, German and Italian) and being 
increasingly influenced by an internationalism reflected in the use of English as a 
vehicle for intercultural communication, it seems quite apt that such a synthesis be 
attempted in Switzerland and that the project be lead by an Australian! 



Analysis of current trends 

The strategy chosen by the project team to fulfil the requirements of their brief 
involved, firstly, the production of separate analyses of school improvement and 
school effectiveness research being reported in the English-, French- and 
German-language professional literature. At this first stage, no attempt was 
made to find a common form for reporting our findings, however we held 
several meetings in which we clarified our understanding of the scope and focus 
of school effectiveness and school improvement work in the three linguistic, 
educational and cultural contexts. We believed that each of us should first get a 



5 



Zentralschweizerischer Be ratungsdienst ftir 
Padagogisches Institut der Universitat Zurich 
recherche sociologique (Favre) . 



Schulfragen (Szaday), 
(Bueler) , Service de la 



good grasp of the work being reported in his own language before attempting 
the desired synthesis. 

The reports produced as background material for the international workshop 
held in November 1994 (BGeler, 1994; Favre 1994; Szaday, 1994) will serve as the 
basis for such a comparison and synthesis in the next stage of this continuing 
project. This current paper presents a summary of the English- and German- 
language reports and represents a beginning of our search for such a synthesis. 6 



English-language report 

The title of the report by the first author Creating effective schools for all (Szaday, 
1994) was carefully and deliberately chosen to: 

• reflect his perception of the dominant direction of contemporary international 
educational research, policy, practice and development in school 
effectiveness and school improvement, as presented in English-language 
research publications; 

• encourage the formulation of productive research questions; 

• offer a useful framework for decision making about future educational 
research activities in Switzerland; as well as 

• provide a conceptual structure for the report. 

Each of the four elements in the title, accompanied by a simple but 
conceptually strong metaphor of travelling 7 , were explored in turn in the report: 

• "creating", expressing developmental considerations (a iournev), 
emphasising research knowledge about the introduction and 
implementation of school improvement activities and organisational 
development strategies employed in effecting school change; 

• "effective", including evaluative considerations (the destination) , focusing on 
the school effectiveness research literature, often resulting in a set of criteria for 
effective classrooms, schools and school districts; 

• "schools", implying analytic considerations (mode of transport) , confirming 
the choice of the individual school as an appropriate unit of analysis and 
focus of intervention for researchers and policy makers; and 

• "for all", highlighting equity considerations (travelling companions) , pointing to 
the need to evolugte the educgtionol experience of groups of pupils whose 
demographic characteristics or membership of particular social, cultural, 
religious or linguistic groups make them vulnerable to an unsatisfying school 
experience or school failure. 
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Unfortunately we were not able to include the French-language report (Favre, 
19 94 ) in this analysis . This will appear in the final publication of the 
project team (Szaday, Biieler & Favre, forthcoming) . 

The use of a similar metaphor by Reynolds, Hopkins and Stoll (1993) and 
Hopkins, Ainscow and West (1994) provided 3ome confirmation of its utility. 

1 7 



A graphical representation of the above is presented in Figure 1 . It was hoped 
that the exploration of these themes would promote the generation of 
productive questions for school effectiveness and school improvement 
researchers in Switzerland, as well as allowing such questions to be reviewed in 
the overall context of contemporary international work. 



Insert Figure 1 about here 



The report was deliberately written in a descriptive style, allowing the Swiss reader 
to "get a feel" of the work being done. "Letting the researchers speak for 
themselves" through the liberal sprinkling of quotations from the research 
literature, as well as an extensive use of footnotes, represented an attempt to 
convey the flavour of the work being reported. It was hoped that the level of 
detail contained in the quotations and footnotes would stimulate hypotheses for 
investigation in the Swiss educational context as well as serve as suggestions for 
readers interested in exploring for themselves the most important original 
sources. 



German-language report 

In comparison with Szaday (1994), the trend report by Bueler (1994) could be 
characterised as more conceptual than descriptive. He addressed certain 
theoretical and methodological considerations for the promotion of school 
quality and school development research in Switzerland, placing such research 
firmly in the context of a broad systems theory and current Swiss German 
educational thinking 8 . An English translation of selected components of his 
analysis is presented in Figure 2. 



Insert Figure 2 about here 



An examination of this analysis reveals consistencies with contemporary English 
contributions to school improvement theory, particularly as recently articulated 
by Hopkins (1994). Understanding issues of school quality and school 
development in terms of a growing professionalisation of the local school as a 
system, which itself exists within broader external support systems, Bueler (1994) 
argued for more competent development practices based on more complex 
theoretical models of how schools change. He maintained that an investment in 
school development research and practice could also have positive influences 
on classroom practice and teacher training. 

The importance of school based enquiry and reflection is highlighted by both 
Szaday (1994) and Bueler (1994). Where they differ, however, is in the extent to 
which they emphasise the link between school improvement and improvement 
of curriculum delivery, that is, between the extent to which the school is 



The tendency towards the use of the terms Schulqualitat ("school quality") 
and Schulentwickluna ("school development") in the German-language 
professional li\ -rature rather than literal translations of the somewhat 
orthodox English-language terms "school effectiveness" ( Schulwirksamkeit ) 
and "school improvement" ( Schulverbesseruqg ) is deserving of further 
attention . 
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conceptualised not only in organisational or system terms, but also as a place in 
which learning and teaching transactions between pupils and teachers occur. A 
concern for classroom and teaching effectiveness seems to be more 
pronounced in the report by Szaday (1994) than that of Bueler (1994). It would be 
premature, however, to claim that this difference in emphasis could be 
generalised to the English- and German-language school effectiveness/quality 
and school improvement/development literature. 

In the coming months, the projer+ team will attempt a deeper analysis of the 
similarities and differences in approaches to school effectiveness and school 
improvement in the three linguistic, educational and cultural contexts (English, 
French and German). It would be our ultimate goal that such a synthesis be 
operationalised within Swiss educational research. 



Surveys of expert opinion 

One approach taken by the authors in their reporting of trends in contemporary 
school effectiveness research and school improvement practice was to 
examine the published international literature. A second approach was to make 
contact with leading researchers and practitioners in the two fields to obtain a 
more direct expression of their perceptions and opinions. In this way, the most 
current ideas could be elicited, often in a more candid form than that emerging 
in print after the refinements of the review process required by journals and book 
publishers. It could also pave the way to the development of personal contacts 
and entry into existing scientific and professional networks. 



English-language researchers 

Surveys were therefore carried out with a selected sample of researchers in the 
areas of school effectiveness and school improvement. Those participating in 
the survey conducted by the first author were asked to express their opinions 
regarding the most significant research questions in the two fields, the 
methodologies required to address these questions and the research 
infrastructure necessary to initiate and maintain research momentum in school 
effectiveness and school improvement. 

The results of this survey (summarized in Figure 3) were not only intended to 
provide the readers of the trend report with another insight into the thinking of 
significant contemporary workers in these fields, but also to stimulate the 
development of an agenda for Swiss school effectiveness and school 
improvement research. A full description of the survey results can be found in 
Szaday (1994). A summary is appended to this paper. 



Insert Figure 3 about here 



German-language researchers 

A similar survey was undertaken by the second author with respondents in 
Switzerland, Germany and Austria. Opinions concerning the most important 
publications, researchers, institutes and projects in the areas of school quality and 
school development were canvassed. Survey participants were also asked to 
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comment on the state of the research effort in these topics in the German- 
speaking countries. 

The main findings from this survey, presented in more detail (in German) by 
Bueler (1994) are: 

• there are particular researchers considered by others to have made, or be 
making, important contributions to school quality and school development 
work (e.g. Fend, Haenisch, Posch, Rolff, Steffens); 

• there are particular institutions considered to be leaders in these fields (e.g. 
the Institut fur Schulentwlcklunnsforschuna at the University of Dortmund, the 
Inndesinstitut fur Schule unH \Afeiterbilduna in Soest, the Hessische? Institut fur 
Bildunasplanuna und Srhulftntwickluna in Wiesbaden, the 7entrum fur 
Schulversuchfi und Schulentwickluna in Klagenfurt and Graz); 

• there needs to be greater attention paid to comparative research and 
theoretical development (both intra- and international); 

• the relationship of school quality and school organisational structures needs to 
be examined; 

• series of case studies of improving schools should be conducted; 

• multilevel methodologies and corresponding theoretical models are lacking; 
and 

• dynamic links between theory, research and practice must be forged within 
the context of supportive research policy and infrastructure. 

International workshop 

A third component of this project was the convening of a two-day international 
workshop in the Swiss town of Solothurn in November 1994. The purpose of the 
workshop was to bring Swiss educational researchers together with selected 
international colleagues to reflect on the implications for Switzerland of trends in 
school effectiveness and school improvement in the English-, German- and 
French-speaking countries. The 25 Swiss participants, representing 16 educational 
research and development institutes, had the opportunity to listen to and interact 
with David Hopkins, David Reynolds and Louise Stoll (from the United Kingdom), 
Hans Haenisch and Ulrich Steffens (from Germany), Jean-Louis Derouet (from 
France), Werner Specht (from Austria) as well as Per Dalin (Norway). 

A major challenge at this workshop was to minimise the language barriers. In 
view of the participation of colleagues from outside Switzerland as well as the 
existence of a vast English-language school effectiveness and school 
improvement literature, it was decided that in addition to French and German 
(the main national conference languages in Switzerland), English would play an 
important role. Invitations to the workshop were written in English, thus assuring the 
attendance of those who had at least passive competence in this language. 
From an analysis of the participants' responses to a question on the registration 
form concerning their self-assessed language skills, it was ascertained that Vd>£ or 
the participants could understand spoken English, 85% spoken French and 85 h 



spoken German. The basis for a high degree of mutual understanding had 
been achieved! 

Unfortunately, it was not possible to achieve at the workshop a high level of 
interaction between those experts coming from outside Switzerland. They were 
able to present their own work, engage in fruitful discussions about the 
implications of such work for the Swiss context as well as provide role models for 
inter-institutional collaboration. However, progress towards a synthesis of 
approaches arising out of distinct national, linguistic and cultural contexts (a goal 
of this project) did not really occur. This task will be attempted in the final report of 
this project (Szaday, Bueler and Favre, forthcoming), in which the proceedings 
of the workshop will also be published. 



Recommendations 

In their desire to stimulate school effectiveness and school improvement 
research in Switzerland, the expert committee coordinating the NRP33 requested 
that the project group provide recommendations based on their perceptions of 
contemporary international trends. These recommendations could then serve 
as a basis for the distribution of remaining program funds as well as providing an 
impulse for the Swiss educational research community in the future. 

The individual trend reports by Bueler (1994), Favre (1994) and Szaday (1994) 
contain some initial recommendations following from their own analyses. A 
further source are the workshop contributions of those researchers from outside 
Switzerland who were invited to attend. 

Although not yet systematically formulated at the time of writing this paper, 
Szaday, Bueler and Favre (forthcoming) will contain recommendations in three 
areas (corresponding to the structure of the English-language survey described 
above): 

• the most significant questions to be researched in school effectiveness and 
school improvement; 

• the methodologies required to address these questions; and 

• the infrastructure necessary to initiate and maintain research momentum in 
school effectiveness and school improvement. 

It is in the third area that the project group have already provided the expert 
committee with some suggestions. Among those mentioned were: 

• targetted funding of school effectiveness and improvement research and 
development centres; 

• the launching of a relevant German-language professional journal; 

• the publication of a school development yearbook; and 

• the subsidising of training programs for school development consultants. 

It remains to be seen to what extent our ideas are accepted, and indeed 
acted upon! 
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Unintended outcomes 



Although the terms of reference of the research grant received by the authors 
only mentioned the production of a report into international trends in school 
effectiveness and school improvement research and the convening of an 
international workshop, the actual outcomes flowing from this project have been 
much greater. And perhaps unintended by the expert committee 
commissioning this work! 

These extended outcomes, not only for the authors as individuals but also for the 
institutions in which they work, fall into the following areas: 



Research 

Through the interest generated by his participation in this project, the second 
author has been instrumental in establishing a School Quality and School 

Development Research Area ( Forschungsbereich Schulaualitat und 

Schulentwickluna - FSS) at the Institute of Education of the University of Zurich. At 
the time of writing „ 14 related research projects, most of which are being 
undertaken by students, are underway. One of these, a case study of the school 
changes brought about by a program to integrate children with learning 
difficulties into regular primary school classes, involves the evaluation of a project 
in which the first author is engaged as a consultant. This institutional collaboration 
between this school, the university and the Central Swiss Educational Consultancy 
Service has only occurred as a result of the personal contacts between the two 
authors arising out of their collaboration on the present project. 

The involvement of the first author in a two-year European project concerning 
self-evaluation of schools, being sponsored by the Consortium of Institutions for 
Development and Research in Education in Europe (CIDREE), has also been an 
offshoot of the current grant. 



Professional development 

Through his attendance at a conference in Germany related to the theme of this 
project, the second author had the opportunity of becoming acauainted with 
Per Dalin, whose publications and training courses for school improvement 
consultants are well-known to a Scandinavian-, English- and German-language 
professional audience. As a result of this and other contacts, the second author 
has arranged to spend his upcoming sabbatical leave with IMTEC and the 
University of Oslo in Norway as well as with the International School Effectiveness 
and Improvement Centre at the Institute of Education of the University of London, 
in order to gain more experience of international school improvement projects. 

The first author, through his position at the Central Swiss Educational Consultancy 
Service, is responsible for planning a training program for school improvement 
consultants in central Switzerland (possibly also in association with IMTEC). His 
association with the project described in this paper has certainly helped to focus 
his areas of interest at his own place of work. 
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International networking 



The undertaking of this project brought the first author into contact with the 
publications and the people associated with the International Congress for 
School Effectiveness and Improvement (ICSEI). This contact has lead to his 
recent appointment as Editor of the Network News International of ICSEI, thus 
involving him in questions of school effectiveness and school improvement 
going far beyond the original brief of the commissioned research. It is hoped 
that basing this newsletter in Switzerland will benefit the Swiss educational 
research and development community. 

Similarly, the second author has been included in the activities of the German- 
language network (Arbeitskreis Schulaualitat) based in Wiesbaden and 
Constance. The opportunities for mutual exchange and collaboration offered 
by this network will be of both personal and institutional benefit! 



Postscript 

The project described in this paper has not yet come to an end. The formal 
aspect of the work will be completed v.rith the final publication in mid 1995. 
However, the contacts developed and the associated projects launched 
during the past year will certainly continue and perhaps even spawn new ones. 

The authors of this paper look forward to their continuing collaboration as well as 
the challenges and stimulation of intercultural approaches to the school 
effectiveness and school improvement enterprise. 
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Figure 1 

Possible research questions reflecting the dominant direction of contemporary 
English-language educational research, policy, practice and development in 
school effectiveness and school improvement (from Szaday, 1994) 



A JOURNEY 



THE DESTINATION 



evaluative 
considerations 

• What are the 
characteristics of 
effective schools 
in Switzerland? 

• How is school 
quality defined in 
Switzerland by 
pupils, parents, 
teachers, school 
administrators, 
policy makers 
and educational 
researchers? 



TRAVELLING 
COMPANIONS 



developmental considerations 

• what are the driving forces behind local 
school improvement initiatives in 
Switzerland? 

• what hinders local school development 
or innovation activities in Swiss schools? 



creating 



effective 



schools 



for all 



equity considerations 

• for which groups of pupils are Swiss 
schools effective? 

• what educational programs or 
processes are being implemented to 
reduce educational disadvantage? 



MODE OF 
TRANSPORT 



analytic 
considerations 



• how do the 

characteristics of 
the individual 
classroom, local 
school and 
cantonal 
education system 
contribute to 
educational 
quality in Swiss 
schools? 
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Figure 2 

Theoretical and methodological considerations for the promotion of school 
development research in Switzerland (Bueler) 



Professionalisation of the school as a system 



• Personal development and individual support for "problem cases"; 

• Promotion of problem solving capacity and cooperative work cultures; 

• Development of internal and external support systems; 

• Institutionalisation of processes of reflection. 



School quality research 




School development research 



The sustained development of schools calls for the establishment 
of regional advisory and research services as well as centres for 
school effectiveness and school improvement from which 
theoretical, personal and logistic skills can be accessed on a 
project basis by local schools. 



More competent practice and more complex theory 



Information internal to the school as a system (everyday knowledge, 
problem perception, goal objectives, etc.) and external information 
(theories, evaluation data, diagnoses, strategies, etc.) become 
linked in the school development process. 



. 
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School development as investment in the future 



Future achievements and functions of school improvement 
research: 

• practice related and locally determined school development 
concepts; 

• accompanying process research, consultancy and supervision; 

• instruments for the diagnosis and evaluation of school auality; 

• empirical-analytical and future-oriented theory. 

School improvement will only be successful when it results in . . . 

(a) sensitising and motivating school practice; 

(b) building up appropriate initial teacher training and professional 
development programs; 

(c) long-term accumulation of necessary resources. 
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Figure 3 

Results of survey of expert opinion (from Szaday, 1994) 



Lines of inquiry 

Multilevel measurement of 
school effects 

School change processes 

Social context of schooling 

Theory development 
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Appendix 

Survey of expert opinion (Szaday, 1994) 



A covering letter explaining the current project and questionnaire were sent by 
the first author to 57 school effectiveness and school improvement researchers in 
ten countries. Included in the sample were the authors of papers published in 
the 1992 and 1993 issues of the specialist international journal School Effectiveness 
and School Improvement . Also included were a selection of writers of frequently 
cited books and articles (published within the past ten years), who were 
considered to have made a signficant theoretical or empirical contribution to 
the study of school effectiveness and school improvement. 

The questionnaire contained open-ended questions eliciting opinions about: 

• significant or productive research questions or lines of inquiry; 

• recommended methodological approaches to answering these questions; 
and 

• the infrastructure considered necessary for the stimulation and maintenance 
of a national school effectiveness and school improvement research effort. 

Completed survey forms were received from 25 researchers from the United 
States of America (9 responses), the United Kingdom (5), Canada (4), Australia 
(3), Hong Kong (1), Macau (1) and Norway (1). The participation rate of 43.9%, 
while not especially high, was also not considered to be depressingly low. 



Lines of inquiry 

The first question answered by those responding to the survey was: "In your 
opinion what are currently the most significant or productive research questions 
or lines of inquiry for school effectiveness and school improvement researchers?" 

A content onalysis of these reponses revealed five broad clusters of productive 
or important lines of inquiry 9 , the first two of which were mentioned by almost half 
the respondents: 

• the multilev el measurement of school effects , i.e. unravelling the effects on 
school performance of individual, classroom, school and social contextual 
factors; and 

• exploring the dynamics of school change , i.e. understanding the effects of 
organizational structures and processes on school improvement. 



ERIC 



At the beginning of the content analyis, I tried to distribute the responses 
into the twelve subtopics of school effects research suggested by Teddlie 
and Roberts (1993) : school change; teacher-school interaction; context 
isses; role of leadership; stability/consistency issues; curriculum issues; 
methodological issues; variance issues; theory; existence /magnitude issues; 
district/state effects; and international studies. Unfortunately, the 
attempted categorization of responses into this schema resulted in a high 
degree of overlap. The five clusters outlined above seemed to distinguish 
them better. 
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These two clusters clearly depict the different interests of the "scientists" and 
"humanists" described by Teddlie and Roberts (1993). They are also consistent 
with Scheerens' (1992, 1993) distinction between "foundational research" (i.e. 
directed at establishing school effectiveness as a scientific construct) and 
"applied research" (i.e. concerned with educational indicator systems and 
evaluation of school improvement projects). The separate traditions of school 
effectiveness and school improvement research are reflected here. 

Issues of educational policy development are reflected in the third cluster of 
responses. Thev focus on the social, political and economic context in which 
criteria for assesring educational quality provision and school effectiveness are 
established. Approximately one quarter of the respondents mentioned research 
questions or lines o : inquiry which could be included in this cluster. 

A fourth cluster of responses advocated theory development in school 
effectiveness. Almost a quarter of the respondents mentioned the desirability of 
work directed towards the clarification of concepts, possibly within an 
interdisciplinary framework, and hopefully leading to practical outcomes. This 
cluster corresponds to what Scheerens (1992, 1993) describes as "fundamental 
research" (i.e. the further development of school effectiveness models and 
theories). It represents his third strand of "state-of-the-art" school effectiveness 
studies. 

Investigation of the effects on pupil learning of specific curriculum initiatives w as 
mentioned by a small number of respondents as a productive direction for 
school effectiveness research, and formed the fifth cluster of responses. The 
exploration of direct links between learning and teaching reflects an orientation 
already found in the instructional effectiveness literature. 



Methodological approaches 

The second question answered by those responding to the survey was: "Which 
methodological approaches would you recommend in order to address the 
research questions you outlined above?" The most common response 
(specifically mentioned by 40% of the surveyed experts) was that both 
quantitative and qualitative research methods were needed in school effective- 
ness and school improvement research. Terms such as mixed-method and 
multimethod were used to characterize such an approach. This view is most 
effectively represented in the following comment from one respondent: 

It is essential, in my view, that multiple methodologies are utilised to address the above 'cutting 
edge' issues. Quantitative data has its uses, particularly connected with the generation and 
testing of relationships between variables. Qualitative data also Is useful in the exploration of 
why it is that these relationships exist. (Respondent #16) 

An analysis of the specific research techniques mentioned by respondents is 
illuminating and points once again to the separate traditions of school 
effectiveness and school improvement research. 

Quantitative approaches, usually associated with school effectiveness research, 
were mentioned by many respondents: 

• questionnaires ("survey research", "survey methods", "opened ended 
surveys", "climate variables"); 

• student achievement tests ("academic teste", "achievement studies", 
"student performance"); 
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• existing school records: and 

• experimental studies ("planned variation studies", "quasi-experimental", 
"field experiments") 

The specific techniques of statistical analysis recommended by the respondents 
for the generation and testing of quantitative relationships included discriminant 
analysis, multivariate analysis, multilevel modelling, regression techniques and 
path analysis. 

Qualitative methods are most usually employed in school improvement 
research. Those mentioned by respondents as particularly appropriate were: 

• interview techniques ("structured interviews" , "student interviews"); 

• observation and description ("systematic classroom observation", "ethno- 
graphic studies"); 

• cose studies ("intensive portraits of individual classrooms and schools"); 

• evaluation studies ("evaluation of school improvement projects"); 

• longitudinal studies: 

• comparative studies ("cross case methodology"); 

• games and tasks: and 

• action research and reflective practice . 



Necessary infrastructure 

The third question answered by those responding to the survey was: "What 
funding, institutional or professional infrastructure or processes do you consider 
necessary or important to both stimulate and maintain a viable national school 
effectiveness and school improvement research effort?" A content analysis of 
the responses revealed five underlying clusters. 

The first requirement for a viable national research effort in school effectiveness 
and school improvement is a commitment within the research community to the 
idea that these questions are indeed worth exploring. Although mentioned by 
only two respondents, the importance of a desire to improve the effectiveness 
of schools 10 and a willingness to learn from improving schools, or from those 
already effective, cannot be overemphasized. 

The expected issue of sufficient funding was raised by a significant number of 
respondents. Sources of such research funding could include national science 
foundations, federal and state governments or private bodies. However, the 
guarantee of long term funding of designated, specialist research centres which 
nevertheless worked collaboratively with other research groups was 
advocated. The interesting question of direct funding to schools for their 
participation in research projects was raised by one respondent. 

The need for networking and collaboration among school effectiveness and 
school improvement researchers and practitioners, both at national and 
internatonal levels, constituted the third cluster of responses. It was mentioned by 
more than a third of the respondents. Such networks would encourage inter- 



10 Consistent with Fullan's (1993) discussion of the "moral purpose of 
education" . 
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institutional links, resulting in increased communication of research strategies and 
results as well as promoting cooperative research programs. Linkages with 
related international projects and professional groups would support the 
development of comparative perspectives, resulting in greater insight into local 
conditions. 

A fourth cluster of responses, mentioned by a quarter of the respondents, 
concerned the development of productive relations hips with schools. The 
synthesis of research-generated knowledge and practice-based experience is 
perhaps the main challenge facing an educational research community which 
often finds itself ignorant of the day-to-day reality of life in schools. The production 
and dissemination of useful knowledge should be a criteria of effectiveness of 
school effectiveness research 1 1 ! 

A small number of respondents referred to the possiblities raised by linking a 
research effort in school effectiveness and school improvement to existing 
curriculum or school quality initiatives of government or responsible education 
authorities. This fifth cluster of responses supports the contention that research 
should be directed towards answering the questions that are being raised in 
schools and school systems. If seen to be doing so, the chances of the research 
effort being integrated into these initiatives would be so much greater. 
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